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Description 

Method for determining the current position of the heads of 
vehicle occupants 

5 

The present invention relates to a method for determining the 
current position (A, B, C, D ...) of a head of an occupant in 
the passenger compartment of a motor vehicle, said head moving 
toward a dynamic disabling zone in front of an air bag module. 

10 

Future restraint systems in motor vehicles will have to take 
into account the current position of the heads of vehicle 
occupants, in order to achieve the optimum protective effect 
during airbag activation. These developments are also driven 
15 by legislative initiatives, for example in the US by 
legislative initiative FMVSS 208. 

A important element of such legislation is the automatic 
dynamic disabling zone in front of the airbag module 

20 (hereafter referred to as the critical out of position zone or 
COOP. The limit of this zone is typically located at a 
distance of around 10cm from the airbag module toward the 
occupant. If during an accident (e.g. as a result of total 
brake application) the head of the vehicle occupant is thrown 

25 toward the airbag module, the legislation requires the airbag 
to be disabled before the head or torso enters the COOP zone. 
A critical factor here is the distance from the part of the 
head (generally the face) or torso (generally the chest) 
facing the airbag to the airbag module. 

30 

An important criterion for optimizing this function is the 
size of the so-called switch zone. On the one hand the airbag 
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must be deactivated before the head enters the COOP zone but 
on the other hand the occupant must not be denied any 
protection potential at an adequate distance from the airbag. 
The switch zone should therefore be as small as possible. The 
5 size of the switch zone is typically around a few centimeters. 

Contactless systems and primarily optical systems have been 
developed to measure the distance of the head of the occupant 
from the airbag module. These optical systems are preferably 
10 3D cameras, which operate according to the stereoscopic 

method, the pencil of light method or TOF (time of flight) . 

Such image acquisition units are typically integrated up in 
the roof module between the vehicle seats (see Figures 1 and 2 

15 below) • The advantage of this integration position is that 
under normal circumstances the camera cannot easily be 
covered, e.g. by occupants reading newspapers. One 
disadvantage is however that when the head enters the COOP 
zone, the camera cannot see the part of the head facing the 

20 airbag module, i.e. generally the face. In this instance the 
image acquisition unit is looking at the back of the 
occupant's head. 

It is known that this problem can be resolved by assuming a 
25 mean head size. However this assumption is subject to not 

insignificant error in the case of bouffant hairstyles, head 
coverings, etc. The assumption no longer applies in such 
cases. The switch zone must therefore be big enough to cover 
most scenarios given this uncertainty. 

30 

Figure 3 illustrates this situation. In head position A 
(seated normally) the camera sees the face of the occupant but 
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not the hair. In head position B (face at limit of COOP zone) 
the camera looks at the back of the occupant' s head and sees 
the hair but no longer the face of the occupant, 

5 Figure 4 shows that if a mean head size is assumed, even a 
slightly bouffant hairstyle can result in the camera 
determining a position outside the COOP even though the head 
has already entered the COOP. 

10 The object of the invention is to specify an improved method, 
which avoids the above disadvantages, and a device for the 
exact determination of the position of the heads of vehicle 
occupants. In particular the invention should allow the 
smallest possible switch zone to be achieved, so as not to 

15 deny the occupant any protection potential at an adequate 
distance from the airbag module. 

This object is achieved by the independent claims. 
Advantageous embodiments and developments, which can be 
20 deployed individually or in combination with each other, are 
set out in the dependent claims. 

A first method according to the invention for determining the 
exact position (A, B, C, D ...) of a head of an occupant in the 

25 passenger compartment of a motor vehicle, said head moving 
toward an automatic dynamic disabling zone in front of an 
airbag module, using an image acquisition unit with an ideal 
line of sight, which is essentially perpendicular to the ideal 
direction of movement of the occupant, is characterized in 

30 that the image acquisition unit is used at least cyclically to 
record an image scenario including the occupant, i.e. an image 
area including the occupant, in the passenger compartment of 
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the motor vehicle and to detect image information relating to 
the occupant; in the respective current scenario image both 
the position of the geometric center of the head and the 
apparent size of the head are determined, in particular 
5 measured in the direction of movement; the respective current 
lines of sight of the image acquisition unit are defined as a 
vector from a defined position of the image acquisition unit 
to the respective current position of the geometric center of 
the head; the respective current angle a between the ideal 

10 line of sight and the current lines of sight of the image 

acquisition unit are calculated; the respective current values 
for angle a and apparent size of the head are stored in a 
storage unit; and the value from the storage unit for which 
the absolute sum of the difference between angle a and 0° was 

15 minimal is always assumed to be the size of the head. 

Contrary to the prior art therefore instead of a mean head 
size, an apparent and therefore ultimately real head size is 
determined. Then during the for example parallel position 

20 calculations the head sizes, which are closest to the actual 
head size and in the best instance may even correspond to it, 
are selected from the set of head sizes thus determined and 
used as the basis for calculation. Using a head size based on 
reality for determination of the current position in front of 

25 the airbag module advantageously gives a much more exact 

position determination than is possible with the prior art and 
therefore allows a significantly smaller switch zone to be 
achieved, thereby increasing the protection potential for the 
occupant of the vehicle. 

30 

The present invention also relates to a method for determining 
the exact position (A, B, C, D ...) of a head of an occupant in 
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the passenger compartment of a motor vehicle, said head moving 
toward an automatic dynamic disabling zone in front of an 
airbag module, using an image acquisition unit with an ideal 
line of sight, which is essentially perpendicular to the ideal 
5 direction of movement of the occupant, the image acquisition 
unit being used at least cyclically to record an image 
scenario including the occupant, i.e. an image area including 
the occupant, in the passenger compartment of the motor 
vehicle and to detect image information relating to the 

10 occupant; both the position of the geometric center of the 

head and the apparent size of the head being measured in the 
direction of movement in the respective current scenario 
image; the respective current lines of sight of the image 
acquisition unit being defined as a vector, from a defined 

15 position of the image acquisition unit to the respective 
current position of the geometric center of the head; the 
respective current angles (3 between the direction of movement 
of the head and the current lines of sight of the image 
acquisition unit being calculated; the respective current 

20 values for angle |3 and the apparent size of the head being 

stored in a storage unit; and the value from the storage unit 
for which the absolute sum of the difference between angle (3 
and 90° was minimal being assumed to be the size of the head. 
This method also has the advantages mentioned above. 

25 

In a preferred embodiment of the invention the image 
acquisition unit is a 3D camera, which operates according to 
the stereoscopic method, the pencil of light method, the time 
of flight method or another equally appropriate method. Use of 
30 a 3D camera, in particular in respect of the last mentioned 
method according to the invention, advantageously allows 
determination of the current position independently of ideal 
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6 

movement directions and/or lines of sight based on actual 
movement vectors in three-dimensional space. 

Instead of carrying out a position determination based on an 
5 ideal direction of movement, it is therefore preferably 
proposed according to the invention that the respective 
current angle (3 is calculated between a current actual 
movement vector of the head and the current line of sight 
vector of the image acquisition unit. This advantageously 
10 enhances the reliability of the method according to the 

invention even when an occupant is sitting with a lateral 
orientation, as for example occurs normally when looking out 
of a side window, etc. 

15 Because the respective last or previous value for the position 
of the geometric center of the head is preferably stored, the 
respective current movement vector can advantageously be 
calculated in a simple manner from the stored last and the 
current 3-dimensional positions of the head. 

20 

According to the invention the defined position of the image 
acquisition unit is preferably based on the center of a lens 
aperture of the image acquisition unit, in the case of the 
stereo camera for example the left lens. 

25 

In a further preferred embodiment of the invention, the image 
acquisition unit records images of the relevant scene 
continuously, at least 25 images per second, in particular at 
least 30 images per second, preferably at least 35 images per 
30 second, so that film speeds, i.e. online viewing, can actually 
advantageously be achieved. 
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The size of the storage unit is such that at least all the 
measured values of a slow head movement from a first head 
position (A), i.e. an initial position, to the relevant second 
head position (B) , namely the position with the face at the 
5 limit of the COOP area, can be stored. 

In one expedient embodiment of the invention the storage unit 
is a ring buffer store, which is first filled and from then on 
the oldest value is replaced by the current value. 

10 

It has also proven advantageous for the recordings of the head 
movement to be filtered using filters such as Kalman filters 
and/or movement models. 

15 It should be noted specifically that instead of determining 
the head position, with the image acquisition unit any other 
appropriate part of the body of an occupant can be used as the 
basis for calculating the position of said occupant, such as 
in particular the size of the torso of the occupant in the 

20 motor vehicle. 

In a further preferred embodiment of the invention it is 
proposed that different views of the occupant be combined to 
provide a 3D overall view of the person. This advantageously 
25 allows simulation for example of the front or facial profile 
of the occupant in front of the plane of the COOP limit from 
the overall view and therefore more accurate calculation of 
its distance from the disabling zone or the airbag module than 
with the prior art. 

30 

For the sake of completeness, it should be pointed out that 
the invention also of course relates to a device corresponding 
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8 

to the method for determining the current position (A, B, C, D 
...) of a head of an occupant in the passenger compartment of a 
motor vehicle, said head moving toward an automatic dynamic 
disabling zone in front of an air bag module, said device 
5 being characterized by appropriate means for carrying out the 
method as described above. 

Particular problems relating to the legislative initiative 
FMVSS 208 mentioned above are known to be posed by the 

10 validatability and reproducibility of the head position 

measurements in the context of the licensing procedure for a 
camera system. By improving the head position determination 
even by a matter of centimeters, the present invention can 
offer crucial advantages both here and in the field. By 

15 advantageously enhancing the protection potential of an 

occupant in a motor vehicle thus, the present invention is in 
particular suitable for occupant protection systems in modern 
motor vehicles. 

20 The invention is described below with reference to different 
exemplary embodiments and in conjunction with the drawing, in 
which: 

Figure 1 shows a schematic diagram of a top view of a typical 
25 integration location for an image acquisition unit in the 
passenger compartment of a motor vehicle; 

Figure 2 shows a schematic diagram of a side view of the 
integration location according to Figure 1; 

30 

Figure 3 shows a schematic diagram of the measurement of the 
head positions of an occupant assuming mean- head sizes; 
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9 

Figure 4 shows a schematic diagram of the incorrect 
measurement based on the assumption according to Figure 3 of 
the head positions of an occupant with a bouffant hairstyle 
5 for example; 

Figure 5 shows a schematic diagram of a first exemplary 
embodiment of the measurement of head positions according to 
the invention; and 

10 

Figure 6 shows a schematic diagram of a second exemplary 
embodiment of the measurement of head positions according to 
the invention. 

15 Figure 1 shows a top view of the typical integration location 
of an image acquisition unit 16 in the passenger compartment 2 
of a motor vehicle 1. 

Figure 2 shows a side view of the diagram in Figure 1. 

20 

An image acquisition unit 16, for example a 3D camera, is 
generally integrated in a module up in the roof liner 20 
between the vehicle seats 3. An airbag module 5 is housed in 
front of the seats 3, typically in the dashboard 4. An 

25 automatic dynamic COOP disabling zone 6 in front of the airbag 
5 serves for the statutorily required protection of ah 
occupant 8 from injury by the airbag 5, if a minimum distance 
therefrom is not observed. The advantage of the integration 
location 20 described above for the camera 16 is that under 

30 normal circumstances it cannot easily be covered, for example 
by occupants 8 reading newspapers. It is however a 
disadvantage that when the head 9 enters the COOP zone 6, the 
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10 

camera 16 cannot see the part of the head 9 facing the airbag 
module 5, generally the face 12. In this instance the camera 
16 is looking at the back of the head of the occupant 9. 

5 It is known that this problem can be resolved by assuming a 
mean head size. This assumption is however subject to not 
insignificant error in the case of bouffant hairstyles, head 
coverings, etc. The assumption no longer applies in such 
cases. A switch zone 7 in front of the COOP zone must 
10 therefore be big enough to cover most scenarios given this 
uncertainty. 

Figure 3 illustrates this situation, i.e. the measurement of 
head positions of an occupant 8 assuming mean head sizes. In 
15 head position A (seated normally) the camera 16 sees the face 
12 of the occupant but not the hair. In head position B (face 
at limit of COOP zone) the camera 16 looks at the back of the 
head of the occupant 8 and sees the hair but no longer the 
face 12 of the occupant 8 . 

20 

Figure 4 shows the incorrect measurement based on the 
assumption according to Figure 3. If a mean head size is 
assumed, even a slightly bouffant hairstyle can result in the 
head 9 entering the COOP zone 6 but the camera still 
25 determining a position outside the COOP zone 6. 

Figure 5 shows a first exemplary embodiment of the measurement 
of head positions according to the invention in principle. To 
this end the size 11 of the head 9 of the occupant 8 is 
30 determined or measured as accurately as possible, particularly 
at head position C. The invention hereby utilizes the idea 
that the best position for a measurement with regard thereto 



2003P06590WOUS 



PCT/EP2004/050411 



11 

is the point in space, at which the ideal direction of 
movement 14 of the head 9 is perpendicular to an ideal line of 
sight 17 of the camera 16. The measurement is then preferably 
carried out when the geometric center 10 of the head 9 crosses 
5 this point. 

A method for determining the current size 11 of the head 9 for 
example implemented in an algorithm can for example be as 
follows : 

10 

Known methods of image processing are used in the respective 
current 3D image to measure the position of the geometric 
center 10 of the head 9, as well as the apparent size 11 of 
the head 9 in the direction of movement 14. 

15 

The current line of sight 18 of the camera 16 is defined as a 
vector, from a defined camera position 19, for example the 
center of the lens aperture, in the case of a stereo camera 16 
for example the left lens, to the position of the geometric 
20 center 10 of the head 9. 

A current angle oc between the ideal line of sight 17 and the 
current lines of sight 18 of the 3D camera 16 is then 
calculated according to known methods of linear algebra. 
25 Alternatively or even cumulatively as a plausibility check for 
example, a current angle |3 can be calculated between the ideal 
direction of movement 14 of the head 9 and the current lines 
of sight 18 of the image acquisition unit 16. 

30 The respective current values for angles a and (3 and apparent 
head size 11 are then stored, preferably in a ring buffer 
store (not shown) , in which the oldest value is always 
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12 

replaced by the current value. The size of the ring buffer 
store is preferably dimensioned such that at least all the 
measured values of a slow head movement 14 from head position 
A to head position B can be stored. 

5 

The value from the current ring buffer store for which the 
absolute sum of the difference between angle a and 0° or angle 
P and 90° was minimal is always assumed to be the size of the 
head. 

10 

Figure 6 shows a second exemplary embodiment of a preferred 
measurement of head positions according to the invention. 

First known image processing methods are used in the 
15 respective current 3D image to measure the position of the 
geometric center 10 of the head 9, as well as the apparent 
size 11 of the head 9 in the direction of movement 14. 

The current line of sight 18 of the camera 16 is also defined 
20 as a vector, from a defined camera position 19, for example 
the center of the lens aperture, in the case of a stereo 
camera 16 for example the left lens, to the position of the 
geometric center 10 of the head 9. 

25 Unlike in Figure 5, the respective last, i.e. previous, values 
are now stored for the position 10, so that an actual movement 
vector 15 of the head 9 can be calculated from the stored last 
and current 3-dimensional head position 10. 

30 The current angle (3 between the actual movement vector 15 of 
the head 9 and the current lines of sight 18 of the 3D camera 
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13 

16 are then calculated according to known methods of linear 
algebra . 

The respective current values for angle p and apparent head 
5 size 11 are then stored, again preferably in a ring buffer 
store (not shown) , in which the oldest value is always 
replaced by the current value. 

The value from the current ring buffer store for which the 
10 absolute sum of the difference between angle (S and 90° was 

minimal, i.e. the geometry was closest to the "perpendicular" 
condition, is always assumed to be the size of the head. 

It should be noted that the methods described above can be 
15 stabilized further by further measures. For example the head 
movement 14 or 15 can be filtered using known filters and 
movement models (Kalman filters) . 

The above methods can also advantageously be applied 
20 correspondingly to the determination of the distance of the 

torso 13 of the occupant from the airbag module 5. The size of 
the torso 13 of the occupant 8 is then detected using the 3D 
camera instead of the size 11 of the head 9. 

25 The above methods can be developed still further by combining 
the different views of the person 8, which" result from the 
different positions A, B, C, ... of the person 8 in relation to 
the camera 16, to form a three-dimensional overall view of the 
person 8, e.g. front view A with person sitting normally plus 

30 side view C with person 8 next to camera 16 plus rear view B 
with person 8 bending. 
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14 

All partial views A, B, C, D, recorded during the forward 

movement of the person 8 by the 3D camera 16 and buffered in 
the ring buffer store, can also be used for the combination of 
partial views A, B, C, ... of the person 8. 

5 

When the person 8 is close to the COOP zone 6, practically 
only the rear of the person is visible to the 3D camera 16. 
The non-visible front 12 of the person 8 can now be simulated 
from the overall view determined above and the distance from 
10 the airbag module 5 can be calculated more accurately. 

The present invention advantageously enhances the protection 
potential of an occupant 8 in a motor vehicle 1. It is 
therefore suitable in particular for occupant protection 
15 systems in modern motor vehicles 1. 



